18:46
2026-06-11
blog.aqnichol.com
machine-learning
Finding Optimal Tokenizers
A researcher developed an algorithm capable of computing optimal tokenizers in certain settings, solving a problem previously considered theoretically intractable. The finding mirrors results in Traveβ¦